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ABSTRACT 

Reported is a field trial of instruments designed to 
identify problems in schools that may be treated by the joint effort 
of school personnel and mental health consultants to schools. 
Participants were 15 mental health consultants who attended a 
workshop and subsequently tried out the recomat-aded procedures during 
the school year 1974 - 75, furnishing data and experiences from 20 
different schools. Evaluated were the following instruments: The 
School Problem Area Survey— -Staff , The School Problem Area 
Survey — Student (both of which are questionnaries) , and The 
Demographic Information Form (a guide for an interview with a school 
principal) . Presented in the text and in tabulated form are data on 
the schools and their reactions to the instru"ients, analysis of the 
data, and comparisons between observed and expected scores. Appended 
are items in the survey instruments (both student and staff forms) 
covering areas such as the following: school attractiveness, 
teacher-student relationships, school-community relationships, 
student problems, administrator problems, facility problems, and 
teacher problems. (IM) 
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FOREWORD 



This report documents a field trial of instrximents developed by 
the Human Resources Research Organization. The instruments were , 
dea^Lgned to identify problems in schools that may be treated by the 
joint effort of school personnel and mental health coosixltants to 
schools. 

The field trial was prece^^ed by a workshop attended by 20 
mental health consultants selected from each of the HEW Regions.^ 
Fifteen of these consultants subsequently furnished the data that 
are the subject of this report. 

Dr. Charles Wlndle, Program Evaluation Specialist, Division of 
Mental Health Service Programs, National Institute of Mental Health, 
was the Project Officer. 

The study was conducted at HumRRO Western Division, Carmel, 
California; Dr. Howard H- McFann is the Divislrm Director. 

The instruments and procedures for their use have been published 
in Surveying School Problems: Some Individual, Group, aind System 
Indicators , by Elaine N. Taylor Robert Vineberg, and S. James 
Goffard, HjmRRO Technical Report 74-22, October 1974. Work on the 
development of the manual was performed under NIMH Grants Number 3 
ROl MH 2I7O8-OI5 -02. The workshop and field trial were supported by 
NIME Grant Number 3 ROl MH 21708-02S1. A conference of participants 
in the field trials i^. to be hald in the fall of 1975. The period of 
performance of the entire study is 1 June 1972 to 31 December 1975. 
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INTRUDUCTION 



BACKGROIM) 

In March 1974 a workshc p was held to introduce the procedures* 
and Instruments developed by the Human Resources Research Organiza- 
tion for identifying mental health problems in schools. The work- 
shop materials were based on a manual, which was subsequently pub- 
lished as Stirveying School Problems: Some Individual, Group, and 
System Indicators ♦■^ The instruments for identifying mental he-^lth 
problems were: 

The School Problem Area Survey:. Staff 
The School Problem Area Survey: Student 
The Demographic Information Fora (DIF) • 

The first two instruments are questionnaires, the third is a guide 
for an interview with a school principal. 

The workshop participants were twcmty mental health consultants 
two selected from each of the ten HEW regions. At the close of the 
work5:hop, each participating consultant agreed to try out the 
recorimended procedures in at least one school during the coming 
school year (1974-1975) and later to report his data and the experi- 
ences he had in collecting them. 

Fifteen consultants furnished data and e^xperiences from 20 
different schools. Fiva of the participants in the workshop were 
unable for one reason or another to carry out the task. 

JThls repcrt T>resents both a compilation of the resultant data 
and comments made by the consultants about the utility of the proce- 
dures and instruments. 



THE INSTRUMENTS 

The School Problem Area Surveys, one for staff and one for* stu- 
dents, are questionnaires in which these two respondeat groups are 



^umRRO Technical Report 74-22, October 1974, by Elaine N. 
Taylor, Robert Vineberg, and S. James Goffard. (Supported by NIMH 
Grant Number 3 ROl MH21708-02. The workshop was supported by NIMH 
Grant Number 3 ROl MH 21708-0281.) 



asked to estlmatti the salience in their school of a variety of poten- 
tial problems. There are 70 items in "the staff questionnaire, and 
49 items in the student questionnaire. The items are used to screen^ 
for types of problems. Using a five point scale, from "e^itreme 
problem*' to "no problem at all," teachers and students are asked to 
rate such items as: 

"The way the ^udeuts get along with one another" 

"Teachers who put too much pressure on their students 
to get good grades" 

"Teachers who,, seem bored with teaching" 

"The way the principal gets along with the students" 

"The amount of influence student opinion has on the 
way the school is run" 

These items make up approximately the first half of each question- 
naire. The remaining items are simple, descriptive words or phrases 
such as cheating, absenteeism, theft, ethnic tensions, and discipline 
(The items of both questionnaires are given in the Appendix.) 

The items are grouped into the following problem areas, although 
the areas are not identified as such on the questionnaires: There is 
considerable overlap between the staff and student forms. The exact 
overlap is best seen by examining the questionnaire items in che 
Appendix. 

Number of Items 



Areas 




Staff - 


Student 


School Attractiveness (SA) 




0 


6 


Student Characteristics & Relationships 


(SS) 


6 


6 


Teacher-Student Relationships (TS) 




6 


6 


Teacher Characteristics & Relationships 


(TT) 


6 


3 


Principal-Student Relationships (PS) 




6 


6 


Principal-Teacher Relationships (PT) 




6 


0 


School-Community Relationships (SG) 




6 


2 


Student Problems (SP) 




14 


11 


Community Problems (CP) . . 




9 . 


2 


Administrator Problems (AP) 




7 


5 


Facility Problems (FP) 




2 


2 


Teacher Problems (TP) 




2 


0 



The DIF, used in an interview with the principal of a school^ 
covers information under five topics: 

General Characteristics of the school and the community 
in which it is located. 

Extrinsic Factors that may affect the school operation. 

Specific School Characteristics , including policies > 
curriculum and programs, and special problems. 

. Staff Characteristics. 

Summarization by the principal of the school's most 
pressing needs and greatest strengths.' 
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THE SCHOOLS AND THEIR REACTIONS TO 
THE INSTRUMENTS 



THE SCHOOLS 

The selected characteristics of the 20 schools showa in Table 1 
indicate the range of variation among them. Since data were collect- 
ed from junior high schools during the development of the instruments, 
the participants in this field trial used the instruments in junior 
high schools whenever possible. 

Of the 20 schools in the sample, eleven are junior high, middle, 
or intermediate schools; six are high schools; and the remaining 
three are elementary schools. All but two are regular public schools: 
school 102 is an alternative high school and school 103 is a parochial 
^ zdd school. These two are also the smallest schools in the sample; 
the others are all "above the median size for schools in general, 
while two, schools 110 and 111, are in the top 2% in size. One, 
school 104, has a substantial proportion (8%) of a Spanish surnamed 
group of students; another, school 112, has a few (3%) American 
Indians. The rest vary from 95% Black to 100% White. Only two, 
schools 104 and 105, however, report student bodies that are 100% 
l-Thite; eight others report small numbers (less than 4%) of various 
minority groups. The staffs of eight schools are 100% t^ite; in the 
remaining 12 they vary from 50% Black and 50% White in school 102 to 
predominantly TThite with a scattering of minorities. 

Most of the schools^^have students from all, or almost all, of the 
five levels used to describe socio-economic status in the Demographic 
Information Form (DIF), though the estimated percentages of each 
varied widely. The socio-economic Icvals have been combined in Table 
1' to indicate either predominantly upper middle class (U) or pre- 
dominantly lower middle class and below (L) . 

The type of area served by these schools also varies considerably, 
from metropolitan inner city to small town or rural, althoiigh small 
city schools are in the majority. 

The characteristics selected for display in Table 1 are not in- 
tended to be exhaustive, hut are merely some that seem most likely to 
be related to the kinds of problems ♦ that might develop in a school. 
The DIF covers a considerable number of other variables, any of which 
mighr. be of importance in a particular school. 

STAFF & STUDENT SAMPLES & TIME FOR ADMINISTRATION OF INSTRUMENTS 

Every effort Tnade to collect data from the entire staff in 
each school. Since the staff samples were close to 100% in most of 
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these schools, the loss of a few sta^f members to non-participation 
or non-cooperation introduces no appreciable bias into the picture of 
the school given by the staff. 

Studient samples were selected generally at random, from either 
the highest or sometimes all of the grade levels shown in Table 1. 
In some schools, one or more entire classrooms of students were used 
on the basis that they were representative of thrf student body. What 
biases may exist in the student samples are unknown, but they are 
presumed to be minimal since the mental health consultants and the 
school staffs employed random or representative selection in choosing 
the samples. 

The questionnaires, as filled out, showed little fevidence ol 
poor cooperation. On the average, 97.7% of the items were answered 
in the staff questionnaires, and 98.0% on the student questionnaires, 
with some variation from one school to another. Since questionnaires 
with large numbers of no responses are discarded without being record- 
ed, these percentages represent maximum values. 1 

When the questionnaires are administered to the staff in a group 
meeting or to the students in a classroom, the time needed is usually,^ 
half an hour. Much more of the consultant's time is needed when group 
GCGGions cannot be arranged, but this was rarely a problem. 

In one school, tenth graders had difficulty with the student 
questionnaire; in another, it was eighth graders; yet in two schools 
where the questionnaire was given to sixth craders, no difficulties 
-were reported. (Statistical analysis places the readability of che 
student questionnaire at the high sixth, grade level.) 
f' . . 

The interview with the principal, using the DIF, took anywhere 
from* half an hour to three hours, although the time most commonly 
reported was 90 minutes. (A longer time to conduct the interview is 
usually a reflection of the principal's desire to extend the discussion 
in areas of interest specific to his/her sdhool.) 

While both positive and negative reactions to the survey iiistru- 
ments were encountered, positive reactions far outnwreighed negative 
ones. Negative instances are reported first, although they were not 
always disastrous. 



^In a pilot study conducted in 50-some schooJs during the devel- 
opment of the instruments, very few respondents, teachers or students, 
returned partially completed questionnaires; apparently those who 
accept this task are likely to carry it to completion. 
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NEGAnVE OR INITIALLY NEGATIVE REACTIONS 



Indispensable to the use of survey instruments such as these, 
of course, is access to an appropriate and cooperative population. 
Since there are often both legal and personal obstacles to such 
access, it is noteworthy that so few of the participating consultants 
reported difficulty in gaining access to an appropriate school. Some, 
of cours^, were already worlcing in a school or could gain entry to 
one through a colleague or through the school system where the center 
was already carrying out work. Only one reported explicitly: 

" . . e we encountered extreme difficulty finding a school 
that would cooperate with us. It appears that the administra- 
tors in the small school systems in this rural area were 
reluctaiit to have their systems "... examined in this way'. 
One school system we finally did gee information from, however, 
did rejDort the experiei^ce to generally be a positive one, 
after they had participated." 

Sheer access, of course, is not enough. " Occasionally a principal 
may be lukewarm or resistant. Even when the principal is cooperative, 
the staff must occasionally be persuaded to cooperate. (Students 
usually are not reluctant to participate.) A few consultants reported 
pdor cooperation. In one school: * 

"... The staff had a very lackadaisical attitude, they 
did not seem to take ?X seriously. ^Ven though I remained in 
the room until they finished, the principal's attitude was so 
light" that she failed to notice^ the final page of her staff 
questionnaire ^ . . The schojDl chose not tc continue with this 
project . . 

la another: 

"... The principal won/t recognize any areas of diffi- 
culty at all. She was less than candid in the interview and 
in the completing of the staff questionnaire ... unable to 
arrange^review of data J' 

In another: ' * 

" . • . teachers at f irs refused to ^f ill out -Staff form- 
because they thought, as contract time was coming up, this 
information might be used against them . (I was much too 
naive in my approach to the teachers - should have planned - 
this phase more carefully.)" 

In still another school, similar difficulties 

" ♦ . • were resolved by emphasizing the experimental nature 
of the instruments and assuring anonjniiity in reports." 

12 



rriUTY OF INSTRUMENTS 



These instruments apparently do serve one of their basic purposes, 
which is to provide a systematic view of the sources of actual or 
potential problems. One consultant noted: 

"The instruments pinpointed areas of conflict and gave 
jspecific problem areas to discuss with school personnels" 

This comment was echoed variously by other consultants* 

Other purposes achieved are indicated by such comments as: 

\ 

"... the instruments and presentation finally brought 
several u.iderlying issues into the open ..." 

• and 

"... there seem to be racial conflicts that were not 
obvious in the original contacts." 

"... no one was aware of the great amount of a'/reement 
between the staff and students. This elicited some respect 
from the staff for the students." 

" • • • The student concern about 'theft' surprised the 
entire staff." 

The instruments also had effects beyond those involved in their 
substantive purposes: 

" . . • the use of the instruments has led to a closer 
liaison with our agency and a more trusting one." 

"... the school ... did report the experience to 
... be a positive one . . . (the consultant) feels we can use 
him (the principal) as a positive referral sour-ce for getting 
into other schools." 

"... Use of instruments gave a rationale for systems 
consultation. Set expectations for indirect service rather 
than directs with staff and administration." 

! 

"The response the instruments have had . . . has been 
exceptionally good. Word of mouth has spread their fame for 
a number of miles in the immediate area and we are getting 
requests to provide both evaluation and consultation services 
starting in the Fall ..." * 
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It is also evident that the instruments can serve a useful pur- 
pose in stimulating remedial activity in troubled schools-. In 12 of 
the schools, programs of intervention are now being planned or are 
already in process- In two of them specific action has been deferred 
until fall. In one school the problems discovered were judged not ^ 
to be disruptive enough to warrant intervention. In five of the 
schools, no consequences of the survey were known at the time of this 
report. 
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BASIC DATA 



Table 2 shows in summary form, the area means that were signi- 
ficantly high or favorable (T of 70 and above) or significantly low 
or unfavorable (T of 30 or below) in each of the 20 schools in the 
group. There is a considerable variation among the schools. Two 
schools, 102 and 113, gave significant responses in onlv three areas 
and in school 102 those were all student responses, whila schools 
111 and 118 gave significant responses in 16 and 15 areas, respectively . 
It does not necessarily follow, however, that schools 111 and 118 are 
nore troubled than schools 102 and 113. The sensitivity of the T-score, 
its ability to detect deviations from the average, is a .iirect 
function of sample size (more accurately, the square root of sample 
size); therefore^, larger samples will, on the average, produce more 
"significant" T-sccres than smaller samples. The data from schools 
111 and 1x8 were based on much larger samples than were the data 
from schools 102 and 113, which accounts for some of the differences 
among them. The nnmber of "significant" T-scores found in a school, 
however, does deper.;! upon the nature of the school. Although very 
small samples may make it impossible to detect even severe problems 
in a troubled school, very„ large samples. will not guarantee the 
appearance of "significant" T-scores by a school that is highly 
contented and placid. 

The findings in the various areas are rather interesting. Four . 
of the schools are rated low in School Attractiveness by their stu- 
dents, but only one is rated high. School-Community Relationships 
are, according to the students, exceptionally good in 16 of the 
schools; the teachers agree in three of the schools, disagree in one 
and find them poor in another where student opinion is not exception- 
al. In ten schools, teachers and students agree that Community 
Problems is a noa-problem area and in three others, either teachers 
or students are of the same opinions, Tn none of the schools is 
Connnunity Problems seen as a problem , ea.In 12 of the schools, 
teachers or students or both rate Student Problems as a problem area; 
in only one is Student Problems given a positive rating by either 
group. According to the teachers,. 11 of the schools have significant 
Facility Problems while in two the facilities are exceptionally good. 
The students concur with the teachers in five instances, disagree in 
one, and rate the facilities as exceptionally good in four schools 
where the teacher ratings were not significant. In 13 schools the 
teachers rated the area of Teacher Problems as exceptionally good and 
in only one school as exceptionally poor. 

Clearly, and not surprisingly, some of the items and areas of the 
questionnaire produce more or less stereotyped favorable or unfavor- ' 
able responses from teachers or students or both. It seems reason- 
able to conclude 3 therefore, that a school showing an unfavorable - 

^A T-score is obtained by calculating the deviation of an item 
mean from the overall mean (of all items) and expressing it in units 
the size of the ?tr»ndnrd error of the overall mean. By use of the 
constants (50 and 10) the distribution of T (as used by^us) has a mean 
of 50 and a standard deviation of 10. T = 50 + 10(Xi- X/s.e.) 
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TABLE 2 



SUMMARY OF SIGNIFICANTLY HIGH (+) AND 
SIGNIFICANTLY LOW (-) AREA MEANS IN 20 SCHOOLS 

AREAS^ 



School 


SA 


ss 


TS 


TT 


PS 


PT 


sc 


SP 


CP 


AP 


FP 


TP 


ID 


b 




T C 
1 O 


T C 

1 o 


T C 
i O 


T 
1 








J. o 




T 


101 




1 

1 












- - 






— 




102 


















+ 




+ 




103 


- 








- 






+ 


+ 








104 
















- - 


+ 






+ 


105 


- 
















+ + 




— 


+ 


106 




- 












- 




— 




— 


107 
















- - 


+ + 




+ 


+ 


108 














-r + 


- 


+ + 




- + 




109 






- 








+ 




+ + 




— 




110 










+ 


+ 




- - 






— — 




111 


- 


+ 






- - - 


- 




— — 


+ + 


- + 


— 


+ 


112 












+ 


+ 




+ 


— 


— — 




113 














+ 












114 


















+ + 






+ 


115 


















+ + 




+ 


+ 


116 














+ 




+ + 






+ 


117 






















+ 


+ 


118 






+ + 






+ 


+ 




+ + 


+ 




+ 


119^ 


















+ + 




+ + 


+ 


120 


+ 




+ + 


+ + 


+ 


+ 








+ 


+ 


+ 



SA - School Attractiveness 

SS - Student Characteristics & Relationships 

TS - Teacher-Student Relationships 

TT - Teacher Characteristics & Relationships 

PS - Principal-Student Relationships 

PT - Principal-Teacher Relationships 

SC - School -Community Relationships 

SP - Student Problems 

CP - Community Problems 

AP - Administrator Problems 

FP - Facility Problems 

IP - Teacher Problems 



^ Student 
^ Teacher 
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response In a generally favorable area probably doeA '^ave problems 
in that area, while a school showing a favorable response in a gen- 
erally unfavorable area has particular strengths in that area. 
Added to this conclusion is the corollary that a neutral response in 
an area generally rated significantly positive or negative may in-- 
dicate latent problems or latent strengths. 

These considerations do not diminish the salience of an area in 
the reports from a particular school. If the teachers or the students 
consider, an area a significant problem or a significant strength in 
that school, that fact cannot be ignored. The interpretation of that 
fact, however, can be tempered by the knowledge that the area is con- 
sidered a problem or a strength in many or most other schools of the 
same sort. 



ANALYSIS OF THE DATA 

Analyses of the data were undertaken with two purposes in mind: 

1. To add a dimension of usual-unusual or expected-unexpected 
to the data. 

2. To compensate for the dependence of T-scores upon sample 
size. 

Analyse^ of the data from the two questionnaires were carried 
out separately for the junior high schools and the high schools of 
our sample. The total numbers of respondents were: 

Junior High High 

Staff ' 378 320 

Student 542 920 

The data from the three elementary schools were not included in 
these analyses since, it will be remembered, the instruments were not 
originally designed for use at that level. 

The first step in the analyses was to consolidate the question- 
naire data. This was done by finding the overall mean rating given 
each item in each questionnaire across all of the schools in each 
category, junior high or high school. It is impossible, however, to 
compare these overall item means directly with the item means found 
in a given school because the schools vary in level of response 
(their general means) . It is also impossible to avoid this difficulty 
by comparing T-scores based on the total sample with the T-scores 
found in a given school because of the gross disparity between the 
sizes of the overall samples arid the size of the sample froa aay school 
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A solution to the dilemma is to compare the T-scores obtained In 
an Individxial school with "expected" T-scores, which are computed 
using the means and sigmas of the total sample but the sample sizes 
( n ) appropriate to the school under consideration. Such comparisons 
show, in effect, the differences between the T-scores ob served in a 
school and the T-scores to be expecfcf4 in an average school where 
the sample size was the same ( n ) y'm the one in the school under 
consideration. Such comparisons are independent of both sample size 
and the. level of response within the school (school mean). If any 
particular itc^nis are systematically affected by sample size (most 
unlikely) or the level of response in a school (a remote possibility), 
the comparisons will be invalid or at least biased for those items. 
These possibilities have been considered improbable for these analyses. 

THE "AVERAGE" SCHOOLS 

To obtain a picture of the average response in the ten junior 
high schools and in the five high schools, all of the overall item 
means were converted to T-scores using a uniform sample size ( n ) 
of 25. With uniform sample sizes all direct comparisons are legiti- 
mate. 

The profiles of these "average" junior high and high schools are 
shown in Figure 1, and their T-scores in Table 3 (junior high schools) 
and Table 4 (high schools) . 

The profiles show that the "average" junior high school in our 
sample has no problem areas and is above average, according to the 
students, in School-Community Relationships, and according to the 
teachers, in a lack of Teacher Problems. In the "average" high 
school in our sample, both teachers and students are concerned about 
Student Problems and '"he teachers see Teacher-Student Relationships 
and a lack of Teache^ Problems as the strong points. 

The item T-scores from the "average" junior high school show the 
followdlng characteristics: 

"Average" Junior High School 

A- Teachers and 5: . v. :its agree that these are problems: 

The number of students who don't like going to school and 
don't do their school work 

Cheating 

• Theft 

Profanity -g q 
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AVERAGE ACROSS 10 JUNIOR HIGH SCHOOLS 



School Problem Area Surveys: 
Summary of Staff and Student Responses 
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h = higher than other group in same school 



L lower S Z^^oixp xn other school (see Table IV) 
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TABLE IV 
AVERAGE ACROSS 5 HIGH SCHOOLS 

School Prohlen) Area Surveys: 
Summary of Staff and Student Responses 
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h == higher than other group in same school 

L = low^^^V ^^^^ ^^nie group in other school (See Table III) 

^'■^ 20 



Items are net comparable 
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Average Junior High Schools 
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Average High Schools 
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B. Teachers add these as probleias: 



Underachievement 
Vandalism 

Discipline • - 

Inadequate programs for gifted sttidents 
Class size 



Students add this as a problem: 

Teachers who are usually boring 

C. Teachers and students agree that this is not a problem: 

Busing to improve racial balance 

D. Teachers add these as non-problems: 

Older teachers who are reluctant to accept newer teachers 
as colleagues 

Teenage parents 

Ethnic tensions 

Changing neighborhood characteristics 

Changing composition of student body 
o Teacher turnover 

Teacher absenteeism 
Students add these as rion-problems: 

Teachers who complain about other teachers 

Teachers who seem bored with teaching 

The way the teachers get along with the parents 

Drop-outs 
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Some of these non-problems no doubt reflect our particular sample 
of junior high schools* The problems however, are very similar to 
those found in the earlier pilot studies in which 50 schools participated 
Interesting is the sharp distinction that the students draw between 
boring teachers and bored teachers. This finding lends credibility to 
student responses, for it appears to indicate that they are reading 
and distinguishing items- 

The item T-scorea» f rom the "average" high school show the follow- 
ing characteristics: 

"Average" High School 

A. Teachers and students agree that these are problems: 

The number of students who don't like going to school and 
don't do their school work 

Cutting class 

Absenteeism 

Theft 

Profanity 

3. Teachers add these as problems: 

Loose or lax policies on student behavior, which foster 
disorderliness and disorganization 

Drop-out rate 

Vandalism 

Discipline 

Students add this as a problem: 

Drugs 

C. Teachers and students agree that these are not problems: 

The usual social atmosphere or feeling in a classroom 
The way the teachers get along with the parents 
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D. Teachers add these as non-problems: 

Teachers who put too much pressure on their students to get 
good grades 

• Unfair treatment of students by teachers 

Teachers who won't admit making mistakes or think there is 
only one right answer to any question 

Older teachers who are reluctant to accept newer teachers 
or colleagues 

Teenage parenus 

Student health 

Changing composition of student body 
Teacher turnover 
Teacher absenteeism 
Students add these as non-problems: 

Teachers* who complain about other teachers 
Teachers who seem bored with teaching 
Dress code 

Again, some of the non-problems are no doubt peculiar to our 
particular sample of high schools. 



Differences Between Teachers and 
Students Within the "Average" Schools 

There are no areas or Items on which teacher and student percep- 
tions are so different that their T-scores are significant in opposite 
directions. They do, however, differ "significantly" from one another 
on some areas and items to the extent of having T-scores 15 or more 
points apaft. In the average jutiior high school, students rate Facility 
Problems (FP) favorably (T,= 60) and teachers rate them unfavorably 
(T = 35) . In the average high school, teachers rate Teacher-Student 
Relationships (TS) high (T = 73) and students rate them relatively low, 
although well above average (T - 58). 
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There are seven it ems on which teachers and students differ t 
their perceptions in both junior r nd senior high schools. These 
seven items would seeaa to represent differences in the points of view 
of teachers and students in general. 

Teachers find LESS of a problem, than students in: 

Teachers who put too much pressure on their students to get- 
good grades 

Unfair treatment of students by teachers 
Busing to improve racial balance 
Teachers find MORE of a problem than students in: 

Teachers who complain about other teachers 

Profanity 

Discipline 

Class size 

Of the seven, only profanity is rated as a real problem (T-score 
of 30 or less) by everyone though, as seen in Tables III and IV the 
T-score3 are much lower for staff (item 49) than for students (item 
39). D iscipline is rated as a real problem by both sets of teachers, 
and class size by the junior high school teachers alone. The T-scores 
of the other four items all fall between 30 and 70. 

In the junior high schools teachers and students disagree on 
three additional items, with the teachers on the lower aide in two. 

Teachers see more^ problems in: 

The way the students get along with one another 

The number of students who don't like going to school and 
don^t do their school work 

Students see more problems in: 



• Ethnic tensions 
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/ . , ^- ■ ■ 

' / In the high schools teachers and students di? ^.gree on f ive addi- _ 
tional items. 

Teachers see more problems in: 
o Cutting class 
Absenteeism 

Dress code . * s ^ 

Students see more problems in: 

. « Teachers who won't admit making mistakes or think there is 
only one right answer to every question 

. The amount of influence student opinion has on the way the 
school is run 

y These latter two sets of differences between teachers and students 
io doubt reflect general differences between junior and senior high 
schools . , . ' 



Differences Between the "Average" Schools 

On the wholei the prof iles of the,vaverage junior high and high 
schools are quite similar. There are no areas on which the T-scpres 
•of either teachers or of students in the one school' differ 15 points 
or more from the T-scores of their counterparts in the other school* 
There are, however, a number of individual items on which differences 
of 15 points or more appear between the two "average" schools. Tliese 
items and disagreements give further insight into the nature of the 
general differences between the junior and senior high schools of our 
sample. 

A. High school teachers and students see more of a :probleiii than 
their junior high school counterparts in these items: 

Cutting class 

Absenteeism 

Drop-out rate 

Drugs 

Alcohol 
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B. Junior high school terchers and students see more of a problem 
than high school teachers and students in: 

• The number of students who don't seem to do imich with 
other students - who are loners 

C. High school teachers find more of a problem than junior hdt^gh school 
^^iaahers in: 

e Loose or lax policies on student behavior which foster 
disorderlinass and disorganization 

Ethnic tensions 

The condition of the building and/or the grounds 

D. Junior high school teachers find more of a problem than high 
school teachers in: 

Teachers who put too much pressure on their students to get 
good grades 

Unfair treatment of students by teachers 

Teachers vho won't admit making mistakes or think there is 
only one right answer to every question 

Teachers ^^^ho complain about other teachers » 

Disagreements among the staff on the proper balance between 
traditional and innovative approaches to teaching 

Profanity 

Student poverty 

• Inadequate programs for gifted students 

• Class size 

E. High school students find more problems than junior high school 
students in: ^ 

The.va^ tha people in this neighborhood feel about the school 

Vandalisoi 
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Junior high school students find more problems than high school 
students in: 

The way the principal gets along with the students 
Dress code 
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COMPARISONS BETWEEN OBSERVED T-SCORES 
OF INDIVIDUAL SCHOOLS AND THEIR EXPECTED T-SCORES 



EXPECTED T-SCORES VERSUS OBSERVED T-SCORES 

In the same way that the T-scores were Computed for the "average" 
schools y average or expected T-scores can be computed for any individ- 
ual school, using the overall item means and standard deviations and the 
n appropriate to that school. 1 

To facilitate th-: computation of "expected" T- '^ores for samples 
of any size, we have zabulated the consolidated data from the ten 
junior high schools (Table 5) and from the five high schools (Table 6) 
in the form of Zs.2 

"Expected" T-scores can be computed directly from Z-scores> since: 

T = 50 + 10 (z/T) 

AN EXAMPLE OF THE USE OF EXPECTED VALUES - INDIVIDUAL SCHOOL 

As an illustration. Table 7 shows a summary form for school 101 
with the observed T-scores on the left and expected T-scores on the 
right in each column, ii plus (+) adjacent to the item number in- 
dicates that the observed T is larger (more favorable) than the average 
or expected T by 15 points or more; a minus (-) indicates that it is 
smaller (less favorable) by 15 points or more. 

The Summary of Mean Ts (lower right corner) shows that the staff 
is concerned about Student Problems (SP) and Facility Problems (FP) 
and sees Principal-Teacher Relationships (PT) and School -Community 
Relationships (SC) as strong points. Comparison* with the expected 
values shows their concern with Student Problems (SP) to be about 
average. The difference between their score on facility Problems (16) 
and the expected score (32) suggests that the school does Indeed have 



n is the average number of responses per item* It is found by 
multiplying the number of respondents or questionnaires (N) by the 
number of items in the questionnaire (70 for staff y 49 for students), 
subtracting the total number of no answers and then dividing the 
remainder by the number of items (70 or 49). 
2 
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TABLE 5 

AVERAGED Z-SCORES FOR 10 JUNIOR HIGE SCHOOLS 
£t»50t1CZVs (n =» Average no. of respondents per item in the school under consideration) 3 



School Problem Araa Surveys: 
Summary of Staff and Student Responses 
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TABLE 6 



AVERAGED Z-SGORESFOR 5 SENIOR HIGH SCHOOLS 
CT = 50 + 10 Z /n) 



School Problemi Area Surveys: 
Summary of Staff and Student Responses 
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worse Facility Problems than most. The surprise is that although they 
show no concern about Teacher Problems (TP) , their score in that area 
(61) is far below the expected value (85) • Although the teachers in 
school 101 are much less concerned about Teacher Problems (TP) than 
they are about some other areas, they are at the same time much les' 
favorable about Teacher Problems than are the teachers in the average 
school. 

The students in school 101 show significant concern only about 
Student Problems and see School-Community Relationships and Teacher- 
Teacher Relationships (TT) as significant strong points. In none of 
the areas, however, are their scores significantly different from 
the expected values- In other words, their responses are quite 
average. 

When the observed and expected T-scores of individual items are 
compared, the picture becomes, of course, more complex. Getting the 
students to show some school spirit (Student Item 3) for example, is 
a very strong point in this school, while Too much noise and confusion 
(Student Item 4) represents a more than average problem* Students 
from ethnic minorities (Staff Item 3, Student.ltem 9) are seen as much 
more of a problem in this school than they are in the average school, 
although the observed values on this item indicate they are less of 
a problem than many other things, (This is school in a small southern 
town with 29% Black students and 71% White students, and a staff that 
is 34% Black, 5% Spanish Surname, and 61% White,) The staff and the 
students express great concern about Theft (Staff Item 43, Student 
Item 35) though their concern matches very closely the average of the 
schools in our sample. On one item: The respect teachers and students 
have for one another (Staff Item 8, Student Item 14) staff and students 
disagree sharply, with the staff seeing it as a real problem and the 
students seeing it as only average. Since the expected Ts for this 
item are fairly close together, these comparisons increase the disparity 
between the staff and the students, with the staff well below average 
and the students well above. The point is probably worth looking into^ 



A FURMER EXAMPLE OF THE USE OF 
EXPECTED VALUES - A SAMPLE OF SCHOOLS 

We also computed the expected area scores for all of the 20 schools 
in our sample, comparing school 102, the alternative high school, with 
the high school averages, and schools 103, 114, and 116, the grade 
schools, with the junior high school averages. Table 8 indicates the 
area and the direction in which each school differed significantly 
(15 points or more) from the average or expected value. 

School 113 is average in all areas, while school 111, with 12 . 
significant differences, is more deviant than any other school. The 
six deviations in school 06 are all positive, whiJ.e the four in school 

109 and the two in schjol iU^; arc all negative. 
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TABLE VII 

SCHOOL 101 0"BSERVED VS "EXPECTED" T-SCORES 



Schoo! Problem Area Surveys: 
Summary of Staff and Student Responses 
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TABLE 8 



AREAS IN WHICH STAFF (T) AND STUDENT (S) MEAN T- SCORES ARE 
"SIGNIFICANTLY" (15 POINTS) ABOVE (+) OR BELOW (-) THE EXPECTED VALUE 



School 

ID 
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109 
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Facility Problems show significant deviations in 15 schools, in 
eight of which teachers and students agree. In none of the schools do 
tha teachers' astUoiates. of Teacher-Student Relationships deviate 
from the average while the students' estimates deviate in three, twice 
negatively and once positivaLy. Only one school (school 120) is. rated 
above average in School Attractiveness, four are rated below and the 
rest are average. Connxunity Problems are given deviant ratings in 13 
schools with the teachers and the students agreeing in three of than • 
The table shews flat disagreements between teachers and students; 
when they both deviated, they deviated in the same direction* 



A CAIT'TON Am A SUGGESTION 

/igain, it must be noted that comparisons such as those we have 
inade are limited to one small sample of schools, selected without any 
explicit sampling procedure. It is to be hoped that in the futxire 
the sijKe of the sample can be increased to the point where we can be 
conf 1 -^;nt that it represents a large number of schools. It does not 
seem .'.ikely, however, that any feasible sampling procedure in the 
future 'dJil enable us to say that it represents schools in general . 

We ho.ve suggested in an earlier report that a more convenient 
way i'or a consultant or a center to proceed would be to survey all of 
the s hoc Is or of a class of schools in a large district. ^ The gen- 
eral meaus will then represent unequivocally all of the schools in 
the district . In practice, the comparisons that are most likely to 
be appropriate are those between one school and the others in the 
sp.zie district, regardless of the way they may deviate from schools in 
p:enerai . 



"SluiiiRRO Technical Report 74-22, October 1974, by Elaine N. Taylor 
Robert Vineberg, and S. James Goffard ( pages 68-69). 
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APPENDIX 



ITEMS AND AREAS IN THE 
SCHOOL PROBLEM AREA SURVEYS 



Student Form 
Staff Form 
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Items and Areas In the School Problem Area Survey; Students 



School Attractiveness 

1. Not enough school subjects to choose from 

2. Not enough extracurricular activities 

3. Getting the students to show some school spirit 
A. Too much noise and confusion 

5. A generally unfriendly atmosphere 

6. The way this school is run 

Student Characteristics & Relationships 

7. The way the students get along vith cne another 

8. The number of students who don't like going to school and don't do 
their school work 

9. Students from ethnic minorities 

10. Friction or hostility between groups of students 

11. Capable students who feel that going to school is pretty much a 
waste of time 

12. The number of students who don't seem to do much with other students - 



Tpacher-Stixdent Relationships 

13. The usual social atmosphere or feeling in the classroom 

14. Tlie respect teachers and students have for one another 

15. Teachers who don't seem to care about the personal and educational 
problems of their students 

16. Teachers who put too much pressure on their students to get good grades 

17. Unfair treatment of students by teachers 

18. Teachers who won't admit making mistakes or think there is only one 



Teacher Characteristics & Relationships 

19. Teachers. who complain about other teachers 

20. Teachers who seem bored with teaching 

21. Teachers who are usually boring 

Principal-Student Relationships 

22. The way the principal gets along with the students 

23. A feeling in the school that conformity and orderliness among the 



students are more important than freedom and individuality 

24. Rules for students that are not clBar but are vagueand indefinite- ■ 

25. The amount of influence student opinion has on the way the school is run 

26. The way students are assigned to classes, graded, and promoted 

27. Unfair treatment of students by the principal or by the people in his ofJ 

School-Community Relationships 

23- The way the teachers get along with parents 

29. Tlie way the people in this neighborhood feel about the school 



who are "loners 



right answer to every question 
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Iteps and Areas In the School Problem Area Survey: Students (Continued) 



Student Problems 



30. Cheating 

31* Cutting class 

32* Absenteeism 



36. 
37 • 
38. 
39. 
40. 



Drugs 
Alcohol 
Delinquency 
Profanity 

Violence or threats of violence 



33 ♦ Dropouts 
34 ♦ Vandalism 



35. Theft 

Comcunity Problems 

41. Ethnic Tensions 

42. Busing to improve racial balar'^e 

Adninistrator Problems 

43. Discipline 

44. Dress code 

45. Useless courses 

46. Not enough counseling 

47. Not enough medical services 

Facility Problems 

43. The condition of the building and/ or the grounds 
49. Class size 
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Items and Areas in the School Problem Area Survey; Staff 



Student Characteristics & Relationships 

" — ■ " — • o 

1. The way the students get along with one another 

2* The number of students who don't like going to school and don't do 

their school work 
3» Students from ethnic minorities 

4. Friction or hostility between groups of students 

5. Capable students who feel that going to school Is pretty much a 
waste of time 

6. '^e ntmiber of students 'who don't seem to do much with other students — 
who are "loners" 

Teachei-'-'Student Relationships • 

7. The usual social atmosphere or feeling in the classroom 

8. The respect teachers and students have for one another 

9. Teachers who don't seem to care about the personal and educational 
problems of their students 

10. Teachers who put too much pressure on their students to get good grades 

11. Unfair treatment of students by teachers 

12. Teachers who won't admit making mistakes or think there is only one 
right answer to every question 



Teacher Characteristics & Relationships 

13. Teachers who complain about other. teachers 

14. Disagreements among the staff on the proper educational goals for the 8ch< 

15. Disagreements among the staff on the proper balance between traditional 
and innovative approaches to teaching 

16. Communication among the school staff 

17. Teachers who seem bored with teaching 

IS. Older teachers who are reluctant to accept newer teachers as colleagues 

Principal-Student Relationships ; 

19. The way the principal gets along with the students ^ 

20. A feeling in the school that conformity and orderliness among the 
students are more important than freedom and Individuality 

21. Loose or lax policies on student behavior Y^lch foster dlsorderlineas 
and disorganization 

22. Absence of a schoolwide system for identifying and dealing with students 
who have special educational needs or problems ' *. 

23. The amount of influence student opinion has on the way the school Is run 

24. The way students are assigned to classes, graded, and promoted 

Principal-Teacher Relationships 

25. The way the principal gets along with the teachers 

26. The. way the principal handles staff conflicts 

27. The amount of teachers^ time taken up by non-teaching activities 

39 
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Items and Areas in the School Problem Area Survey: Staff (Continued) 



Principal-Teacher Relationships (Continued) 

28. Criticism by the school administration of teachers who do not maintain 
tight control pver their students 

29. Understanding how the principal evaluates teaching performance 

30. Disagreements between the principal and the teachers on educational matters 

N 

School-Community Relationship;^ . i 

31. The way the teachers get along with parents 

32. The way the people in this neighborhood feel about the school 

33. Lack of community interest in the schools 

34. Teacher dissatisfaction with the community 

35. Community dissatisfaction with the schools 

36. School policies that conflict with parents' ideas 



Student Problems 

37 . Under achievement 

38. Cheating 

39. Cutting class 

40. Absenteeism 

41. Dropout rate 

42. Vandalism 
V 43. Theft 



44. Drugs 

45. Alcohol 

46. Sexual promiscuity 

47. Teen-age parents 

48. Delinquency 

49. Profanity 

50. Violence or threats of violence 



Coimitunlty Problems 

51. Transient students 

52. Students who speak non* 
standard English 

53 . Ethnic - tensions 

54. Student poverty 

Administrator Problems 



55. 
56. 
57. 
58. 
59. 



60. Discipline 64. 

61. Dress code ' 65. 

62. Irrelevant curriculum 66. 

63. Inadequate programs for gifted students 



Student health 

Changing neighborhood characteristics 
Divisive community Influences 
Busing to improve racial balance 
Changing composition of istudent body 



Inadequate remedial services 
Inadequate cotinsellng servicdis 
Inadequite medical services 



Facility Problems 

67. The condition of the building and/or the grounds 

68. Class size 

Teacher Problems 

69. Teacher turnover 

70. Teacher absenteeism 
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